Express Mail Label SR275502338 US 



HARDWARE CPU UTILIZATION METER FOR A MICROPROCESSOR 

David F. Hepner 
Andrew D. Walls 

5 

Field of the Invention 

The invention described herein relates to central processing unit utilization meters and 
especially to utilization meters used for CPU power management 

10 

Background of the Invention 

Embedded processors are ubiquitous. They are frequently paused, waiting for a request to 
perform a task. However, even when waiting to perform a task, they are consuming 

15 power, frequently limited battery power, and emitting heat. In many mobile 

environments, for example in aircraft, automobiles, and portable consumer electronics, by 
way of example, merely consuming energy while waiting for a task is undesirable, as it 
discharges batteries or requires larger generators or alternators. Even a notebook format 
personal computer wastes heat and battery power waiting for such mundane tasks as the 

20 user typing a single character. 

Similarly, embedded microprocessors pack a lot of functionality into a 25 watt PCI form 
factor, frequently in a drawer with many other cards. The power drain of an unused 
microprocessor is siphoned from utilized microprocessors and thereafter wasted as heat. 

25 

Thus, from both a power management perspective and a thermal management or heat 
dissipation perspective, it would be desirable to be able to throttle back microprocessors 
not currently in use, for example to reduce the clock speed of the CPU and other logic 
when the CPU is idle. Moreover, it would be beneficial to accomplish this in hardware, 
30 without adding to the software load of the processor. 
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Summary of the Invention 



The method and system of our invention provides a hardware based solution to CPU 
5 utilization and power management by throttling back microprocessors not currently in 
use and speeding up needed CPU capacity, for example by reducing the clock speed of 
the CPU and other logic when the CPU is idle. This is accomplished in hardware, without 
adding to the software load of the processor. 

10 The hardware based utilization counter and monitor avoids an additional set of software 
tasks to monitor CPU utilization, and reduces heat dissipation and battery drain. The 
microprocessor system has a CPU, a counter; and a clock. The clock provides a CLK 
signal to the counter when a software task is running on the CPU. The counter counts the 
number of clock pulses since a RESET, and the monitor performs a "sample and hold" on 

1 5 the counter, and provides a control output.. 

The CPU provides a RESET signal to the counter for each CLK pulse whenever a 
software task is not running on the CPU, that is, when the CPU is idle. Conversely, the 
CPU blocks a RESET signal to the counter whenever a software task is running on the 
20 CPU, and continuously passes CLK signals to the counter when a software task is 
running on the CPU. 

The counter outputs a signal that is responsive to its content. This is sampled by the 
monitor which outputs a control signal. The control signal may be a power control signal, 
25 a function control signal, or even a clock control signal, responsive to monitor level. For 
example, the monitor may output a control signal reducing power input or clock pulse 
input to the CPU when monitor level is below a threshold. 



A further aspect of our invention is a method of operating the microprocessor system 
30 where the clock provides a CLK signal train to the counter while a software task is 
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running on the CPU, with the counter counting the number of clock pulses since a 
RESET, and the CPU providing a RESET signal to the counter for each CLK pulse when 
a software task is not running on the CPU. 

5 The Figures 

Various aspects of our invention are illustrated in the Figures appended hereto. 

FIGURE 1 shows a high level diagram of the system of the invention, including a CPU, a 
1 0 bridge, a counter, a utilization monitor, and a clock. 

FIGURE 2 illustrates a hypothetical operation of the microprocessor, including CLK 
pulses, the RESET pulses, a control threshold level, a counter value, and a monitor value. 

2 5 Detailed Description of the Invention 

The method and system of our invention provides a hardware based counter and monitor 
implemented solution for both throttling back microprocessors not currently in use, for 
example by reducing the clock speed of the CPU and other logic when the CPU is idle, 
20 and for increasing clock speed or bringing additional processors on line when additional 
processing capacity is needed. This is accomplished in hardware, without adding to the 
software load of the processor. 

The hardware based utilization counter and monitor avoids an additional set or layer of 
25 software tasks to monitor CPU utilization, and employs a counter and monitor hardware 
solution to reduce heat dissipation and battery drain. The microprocessor system has a 
CPU, a counter; a monitor, and a clock. The clock provides a CLK signal to the counter 
when a software task is running on the CPU, and the counter counts the number of clock 
pulses since a RESET. The number of clock pulses since the last reset (that is, the value 
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carried in the counter) is sampled by the monitor at the time of a reset. This sampled 
value is held by the monitor and is the output of the monitor. 

Figures 1 and 2 illustrate a preferred exemplification of our invention. Figure 1, 
5 illustrates a hardware based utilization meter or monitor that avoids additional sets of 
software tasks to monitor CPU utilization, and to facilitate, for example, reduction of heat 
dissipation, control of battery drain, thermal management, or power management.. The 
microprocessor system has a CPU, 1 1, a counter, 15; a monitor, 17, and a clock, 13. The 
clock, 13, provides a CLK signal to the counter, 15, and the counter, 15, counts the 
10 number of clock pulses since a RESET. A RESET resets the counter, 15, to zero, and 
sets the monitor, 17, to the level of the counter, 15, immediately prior to the RESET 
signal- 
Central to the system is the counter, 15. As used herein a counter is a register that goes 
1 5 through a prescribed sequence of states upon the application of input pulses. In a 
generalized counter the input pulses may be clock pulses or pulses from some other 
external sources, and they may occur at fixed intervals or at random, and the sequence of 
states of the counter may follow a binary sequence of states or any other sequence of 
states. Counters are further characterized as "ripple counters" and "synchronous 
20 counters." In a ripple counter the output of one flip-flop serves as the triggering input of 
a next flip flop. In a synchronous counter the "C" inputs of all of the flip flops receive a 
common input (typically a CLK signal) and the change of state is determined from the 
"present" state of the counter. 

25 The CPU, 1 1 , provides a RESET signal to the counter, 1 5, for each CLK pulse whenever 
a software task is not running on the CPU, 1 1 , that is, when the CPU, 1 1 , is idle. 
Conversely, the CPU, 11, blocks a RESET signal to the counter, 15, whenever a software 
task is running on the CPU, 1 1, and continuously passes CLK signals to the counter, 15, 
when a software task is running on the CPU, 1 1 . 

30 
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The counter, 15, outputs a signal to the monitor, 17, which samples and holds the counter 
output, and outputs one or more control signals, here illustrated as a power control, 19a, a 
function control, 19b, and a clock control, 19c, that are responsive to the monitor output. 

For example, the monitor, 17, may output a control signal reducing power input or clock 
pulse input to the CPU, 11, responsive to monitor content as a measure of CPU utilization 
when the CPU utilization, modeled and represented by count content and monitor 
content, is below a threshold. Alternatively, clock speed may be increased or an 
additional CPU brought on line when the monitor content is above a threshold. 



10 



A further aspect of our invention is a method of operating the microprocessor system 
where the clock, 13, provides a CLK signal train to the counter, 15, while a software task 
is running on the CPU, 1 1 . The counter, 1 5, counts the number of clock pulses since a 
RESET. The monitor, 17, performs a "sample and hold" on the output value of counter, 
15 15,immediatelypriortothelastRESET,andtheCPU, 11, provides a RESET signal to 
the counter, 1 5, for each CLK pulse when a software task is not running on the CPU, 1 1 . 

Figure 2 illustrates on application of the system and method described herein. The dashed 
line, 25, represents the counter level, and the solid line, 23, represents a monitor level 
20 indicating percent CPU utilization. The heavy, horizontal, solid line, 21, represents a user 
or system set Threshold Level for taking some action, as reducing or increasing CLK 
speed, increasing or reducing power, or even starting up or shutting down a CPU. 



At power up of the system (T 0 ), the CPU, 1 1, is assumed to run at 100% utilization until 
25 the first idle time. At this point the reset task is run and resets the counter, 1 5. The 
monitor output, 23, as an indicator of CPU utilization level, drops down to the count 
value, 25, on the counter, 15, at the time of the RESET, point 1 . A short time later the 
CPU, 1 1, is idle again and the monitor, 17, drops the level, 23, to the value of the counter, 
15, at the time of the RESET, point 2. The CPU, 1 1, remains active and the count level, 
30 25, and the monitor level, 23, both exceed the threshold value, 21 , at point 3. 
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The monitor level, 23, continues to increase according to the level, 25, of the counter, 15. 
At point 4 the CPU has another idle time, and the counter, 15, is reset. The monitor level, 
23, holds the level at the time that the counter, 15, was reset, and the counter level, 23, 
5 drops. At point 5 the CPU, 1 1 , encounters another idle time, and the counter 15, is again 
reset, with the counter level, 25, and the monitor level, 23, both dropping.. Points 6 and 7 
represent further idle times and RESET pulses. 

The dotted line, 25, in Figure 2, represents the instantaneous value of the counter, 15, and 
10 the solid line, 23, in Figure 2, represents the value stored in the monitor, 17, which is the 
stored sample value of the counter, 15 (represented by 25) immediately prior to a RESET. 
This provides a "sample and hold" function, and prevents assertion of the controls, 19a, 
19b, and 19c, at every reset, thereby providing a smooth control function. 

15 Of particular note is the "Threshold Level" line, 21. This can be used as a set point for 
various actions, for example reducing clock speed or power when percent CPU utilization 
drops below the threshold, or starting up another CPU when percent utilization exceeds 
the threshold (or another, separately set threshold). 

20 The Threshold Level (or levels) provide one or more control points. With a single 
Threshold Line, as shown in Figure 2, control will be in one state when percent 
utilization is above the Threshold Level, and in another state when the percent utilization 
is below the Threshold Level. 

25 The method and system described herein allow the control of system functions based 
upon CPU, 1 1, utilization with very little support from software or microcode. The 
reaction time to changes in CPU utilization is faster then would be the case with software 
based or microcode based control. By way of contrast, in the case of software based or 
microcode based control, it would take longer to speed up the clock, 15, as the clock, 15, 

30 would still be operating at a lower speed. Moreover, the monitoring software would be 

6 

SJO920030029US1 



Express Mail Label ER275502338 US 

competing for clock cycles with other software processes operating on the CPU, further 
slowing down the response time. 

While the invention has been described with respect to certain preferred exemplifications 
5 and embodiments, it is not intended to limit the scope of the invention thereby, but solely 
by the claims appended hereto. 
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